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CLAIMS 

What is claimed is: 

1. A video editing system or tool for E-commerce, said system utilizing augmented 
reality (AR) technology for combining real and virtual worlds together to provide an 

5 interface for a user to sense and interact with virtual objects in the real world, said system 
comprising: 

a programmable computer for performing data processing of video and calibration data; 
a source of video data coupled to said computer; 

a set of markers for calibration of said camera and for pose estimation of said markers, 
10 for providing calibration results; 

a source of a 3-dimensional (3-D) image data model for a product; 

said computer utilizing said 3-D image data and said calibration results for 
rendering a 3D model; and 

said computer utilizing said 3D model and said video data for generating a 3-D 
15 model with superposition of said 3D model and said video data so as to provide an AR 
video. 

2. A video editing system in accordance with claim 1, wherein said (3-D) image data 

model for a product comprises a VRML model. 

3. A video editing system in accordance with claim 1, wherein said (3-D) image data 
20 model for a product comprises an OpenGL model. 
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4. A video editing system in accordance with claim 1, wherein said a source of video 
data is a video camera. 

5. A video editing system in accordance with claim 1, wherein said said computer 
utilizing said 3D model and said video data provides marker-based calibration to calibrate 

5 the camera and estimate the pose of the markers in the AR video editing system. 

6. A video editing system in accordance with claim 1, wherein said said computer 
utilizing said 3D model and said video data provides image feature extraction and marker 
recognition. 

7. A video editing system in accordance with claim 1, wherein said said computer 
10 utilizing said 3D model and said video data provides virtual reality (VR) model 

rendering/augmentation. 

8. A video editing system in accordance with claim 1, wherein said computer 
performs video compression on said AR video. 

9. , A video editing system in accordance with claim 1, wherein said computer 

15 performs video compression on said AR video for converting said AR video to at least 
one of RealMedia and MPEG Movie format. 

10. A video editing system in accordance with claim 1, wherein said computer adds 
inputted hyperlink information to said AR video after said converting said AR video, so 

as to produce a hyperlinked video message. 

20 11. A video editing system in accordance with claim 10, wherein said computer data 
provides hyper-linking of said AR video to product specification WebPages. 

12. A method for video editing comprising the steps of: 

obtaining video image data from a source; 

extracting feature information data from said video image data; 

25 extracting marking recognition data from said video image data; 

utilizing said information data and said recognition data to derive calibration data 
and pose estimation data for said source; 



14 



Docket No. 2000P07791 US01 



deriving 3-dimensional (3-D) model data for an object; 

utilizing said calibration data, said pose estimation data, said video image data, 
and said 3-dimensional (3-D) model data for an object to perform volume rendering (VR) 
and superposition to produce an artificial reality (AR) image. 
5 13. A method for video editing as recited in claim 12, comprising the steps of: 
setting hyperlink information; 

compressing said AR video so as to produce a compressed AR video; 
adding said hyperlink information to said compressed AR video so as to produce 
an ArEc Video message with hyperlinks. 

10 14. A method for video editing as recited in claim 13, wherein said step of setting 
hyperlink information comprises setting hyperlink information for hyperlinks providing 
product information associated with said object. 

15. A method for video editing as recited in claim 12, comprising the step of: 

sending said ArEcVideo message with hyperlinks on the Web. 

15 16. A system for video editing comprising: 

means for obtaining video image data from a source; 

means for extracting feature information data from said video image data; 

means for extracting marking recognition data from said video image data; 

means for utilizing said information data and said recognition data to derive 
20 calibration data and pose estimation data for said source; 

means for deriving 3-dimensional (3-D) model data for an object; and 

means for utilizing said calibration data, said pose estimation data, said video 
image data, and said 3-dimensional (3-D) model data for an object to perform volume 
rendering (VR) and superposition to produce an artificial reality (AR) image. 

25 17. A system for video editing as recited in claim 16, comprising: 

means for setting hyperlink information; 
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means for compressing said AR video so as to produce a compressed AR video; 

and 

means for adding said hyperlink information to said compressed AR video so as 
to produce an ArEcVideo message with hyperlinks. 

5 18. A system for video editing as recited in claim 17, wherein said means for setting 
hyperlink information comprises means for setting hyperlink information for hyperlinks 
providing product information associated with said object. 
19. A system for video editing as recited in claim 18, comprising: 
means for sending said ArEcVideo message with hyperlinks on the Web. 

10 20. A system for video editing as recited in claim 16, wherein said means for 
obtaining video image data from a source comprises a video camera. 

21. A system for video editing as recited in claim 16, wherein said means for 

obtaining video image data from a source comprises a source of a stored video 
image. 

15.22. A video editing system or tool for E-commerce, said system utilizing augmented 
reality (AR) technology for combining real and virtual worlds together to provide an 
interface for a user to sense and interact with virtual objects in the real world, said system 
comprising: 

a programmable computer for performing data processing of video and calibration data in 
20 real time; 

a source of video data coupled to said computer; 

a set of markers for calibration of said camera and for pose estimation of said markers, 
for providing calibration results; 

a source of a 3-dimensional (3-D) image data model for a product; 

25 said computer utilizing said 3-D image data and said calibration results for 

rendering a 3D model; and 
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said computer utilizing said 3D model and said video data for generating a 3-D 
model with superposition of said 3D model and said video data so as to provide an AR 
video in real time relative to said video data. 

23. A video editing system in accordance with claim 1, wherein said (3-D) image data 
5 model for a product comprises a VRML model. 

24. A video editing system in accordance with claim 1, wherein said (3-D) image data 
model for a product comprises an OpenGL model. 

25. A video editing system in accordance with claim 1, wherein said a source of video 
data is a video camera. 

10 26. A video editing system in accordance with claim 1, wherein said said computer 

utilizing said 3D model and said video data provides marker-based calibration to calibrate 
the camera and estimate the pose of the markers in the AR video editing system. 

27. A video editing system in accordance with claim 1, wherein said said computer 
utilizing said 3D model and said video data provides image feature extraction and marker 

15 recognition. 

28. A video editing system in accordance with claim 1, wherein said said computer 
utilizing said 3D model and said video data provides virtual reality (VR) model 
rendering/augmentation with real time editing capability. 

29. A video editing system in accordance with claim 1, wherein said computer 
20 performs video compression on said AR video. 

30. A video editing system in accordance with claim 1, wherein said computer 
performs video compression on said AR video for converting said AR video to at least 
one of RealMedia and MPEG Movie format. 

31. . A video editing system in accordance with claim 1, wherein said computer adds 
25 inputted hyperlink information to said AR video after said converting said AR video, so 

as to produce a hyperlinked video message. 



17 



Docket No. 2000P07791US01 



32. A video editing system in accordance with claim 10, wherein said computer data 
provides hyper-linking of said AR video to product specification WebPages. 

33. A method for video editing comprising the steps of: 
obtaining video image data from a source; 

5 extracting feature information data from said video image data; 

extracting marking recognition data from said video image data; 

utilizing said information data and said recognition data to derive calibration data 
and pose estimation data for said source; 

deriving 3-dimensional (3-D) model data for an object; and 

10 utilizing said calibration data, said pose estimation data, said video image data, 

and said 3-dimensional (3-D) model data for an object to perform volume rendering (VR) 
and superposition to produce an artificial reality (AR) image. 

34. A method for video editing in accordance with claim 33 wherein said step of 
obtaining video image data includes a step of obtaining accompanying sound data. 

15 35. A system for video editing comprising: 

means for obtaining video image data, including accompanying sound data from a 
source; . 

means for extracting feature information data from said video image data; 

means for extracting marking recognition data from said video image data; 

20 means for utilizing said information data and said recognition data to derive 

calibration data and pose estimation data for said source; 

means for deriving 3-dimensional (3-D) model data for an object; and 

means for utilizing said calibration data, said pose estimation data, said video 
image data, and said 3-dimensional (3-D) model data for an object to perform volume 
25 rendering (VR) and superposition to produce an artificial reality (AR) image. 

36. A video editing system in accordance with claim 1, wherein said source of video 
data comprises a source for associated sound data. 
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37. A video editing system in accordance with claim 36, wherein said source of 
associated sound data comprises a microphone. 

38. A video editing system in accordance with claim 16, wherein said source provides 
sound data and wherein said means for obtaining video image data comprises means for 

5 obtaining sound data from said source. 

39. A video editing system in accordance with claim 22, wherein said video data 
includes associated sound data. 

40. A video editing system in accordance with claim 33, wherein said step of 
obtaining video image data comprises a step of obtaining associated sound data from said 

10 source. 

41. A method for video editing as recited in claim 12, said method being carried out 
in real-time using an ordinary desktop or laptop PC type of computer. 

42. A method for video editing as recited in claim 12, to be carried out in real-time 
that enables a user to rehearse and get visual feed-back in real time. 

15 43. A system for video editing as recited in claim 12, for producing said AR video in 
real time, said video being ready to be broadcast through a network in real time. 

44. A method for video editing comprising the steps of: 

obtaining video image data and associated synchronized sound data from a 

source; 

20 extracting feature information data from said video image data; 

extracting marking recognition data from said video image data; 

utilizing said information data and said recognition data to derive calibration data 
and pose estimation data for said source; 

deriving 3-dimensional (3-D) model data for an object; and 

25 utilizing said calibration data, said pose estimation data, said video image data, 

and said 3-dimensional (3-D) model data for an object to perform volume rendering (VR) 
and superposition so as to produce an artificial reality (AR) image in real time. 
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45. A method for video editing as recited in claim 44 including a step of providing 
said associated synchronized sound data to accompany said AR image in real time. 
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